Exact aggregation of absorbing Markov processes using quasi-stationary distribution
نویسندگان
چکیده
We characterize the conditions under which an absorbing Markovian finite process (in discrete or continuous time) can be transformed into a new aggregated process conserving the Markovian property, whose states are elements of a given partition of the original state space. To obtain this characterization, a key tool is the quasi-stationary distribution associated with absorbing processes. It allows the absorbing case to be related to the irreducible one. We are able to calculate the set of all initial distributions of the starting process leading to an aggregated homogeneous Markov process by means of a finite algorithm. Finally, it is shown that the continuous time case can always be reduced to the discrete one using the uniformization technique.
منابع مشابه
A Note on Quasi-stationary Distributions of Birth-death Processes and the Sis Logistic Epidemic
For Markov processes on the positive integers with the origin as an absorbing state, Ferrari, Kesten, Martinez and Picco [4] studied the existence of quasi-stationary and limiting conditional distributions by characterizing quasi-stationary distributions as fixed points of a transformation Φ on the space of probability distributions on {1, 2, . . .}. In the case of a birth-death process, one ca...
متن کاملQuasi-Stationary Distributions For A Class Of Discrete-Time Markov Chains
This paper is concerned with the circumstances under which a discrete-time absorbing Markov chain has a quasi-stationary distribution. We showed in a previous paper that a pure birth-death process with an absorbing bottom state has a quasi-stationary distribution – actually an infinite family of quasi-stationary distributions – if and only if absorption is certain and the chain is geometrically...
متن کاملQuasi-stationary Distributions for Birth-death Processes with Killing
The Karlin-McGregor representation for the transition probabilities of a birth-death process with an absorbing bottom state involves a sequence of orthogonal polynomials and the corresponding measure. This representation can be generalized to a setting in which a transition to the absorbing state (killing) is possible from any state rather than just one state. The purpose of this paper is to in...
متن کاملBirth-death Processes with Killing: Orthogonal Polynomials and Quasi-stationary Distributions
The Karlin-McGregor representation for the transition probabilities of a birth-death process with an absorbing bottom state involves a sequence of orthogonal polynomials and the corresponding measure. This representation can be generalized to a setting in which a transition to the absorbing state (killing) is possible from any state rather than just one state. The purpose of this paper is to in...
متن کاملQuasi stationary distributions and Fleming-Viot processes in countable spaces
We consider an irreducible pure jump Markov process with rates Q = (q(x, y)) on Λ ∪ {0} with Λ countable and 0 an absorbing state. A quasi stationary distribution (qsd) is a probability measure ν on Λ that satisfies: starting with ν, the conditional distribution at time t, given that at time t the process has not been absorbed, is still ν. That is, ν(x) = νPt(x)/( ∑ y∈Λ νPt(y)), with Pt the tra...
متن کامل